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INTRODUCTION 



A ory is often told of the airplane pilot who interrupted his 
passengers to announce that he had good news and bad. The good news 
was that they were in a jet stream and were making excellent time, the 
bad news— that they were lost. Today, many teacher education programs 
are lost - they are-not moving their students toward an identified goal. 
Competency-based I teacher education is an attempt to prepare prospective 
teachers in terms^ of^specif ied observable goals. It is a significantly 
different kind of^rogram. Stan Elam has defined it as follows: a program 
in which "performance goals are specified, and agreed to, in rigorous detail 
in advance of instruction. The student must either be able to demonstrate' 
his ability to promote desirable learning or exhibit behaviors known to 
promote it. He is held accountable, not for passing grades, but for 
attaining a given level of competency in performing the essential tasks of 
teaching."^ 

Five elements are now generally agreed to be essential to competency- 
based programs. 

1. Teaching competencies to be demonstrated are role-derived, 
specified in behavioral terms, and made public. 

2. Assessment criteria are competency-based, specify mastery levels, 
and made public. 



I'lperformance-Based Teacher Education - What is the state of the art?" 
Stanley Elam, A.A.C.T.E. 1971. 
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3. Assessment requires performance as prime evidence, takes student 
knowledge into account. 

4. Student's progress rate depends on demonstrated competency and 
is therefore, self paced. 

5. Instructional program facilitates development and evaluation of 
specific competencies. 

In the writer's experience there are four other critical elements. 

1. They must contain worthwhile content. 

2. They must be humane. 

3. Eventually competency -based teacher education programs must be 
based on more than assumptions about training experiences and 
teacher skills and outcomes in children and therefore - 

4. The training system must be self -corrective. It must be able to 
seek and respond to feedback from the users of the system. This 
quality of being self -corrective may not be required in competency 
systems but because we are going to make mistakes as we identify 
competencies to be attained by trainees, because the profession does 
not yet have all the data needed on which to base and establish 
competencies, we, therefore, need to build a aelf -corrective system 
which constantly gets feedback from the community, from children 
and parents, from the users of our product, and modify our system 

in terms of that feedback. 
Assessment will be defined here as the generation and use of information 
that supports descisions relative to the trainee or the program . Most 
programs in operation began with, and still spend most of their energy 
attending to assessment problems regarding trainee performance. However, 

4 



-3- 

because of the absolute necessity for all present day CBTE programs to 
be self corrective these materials are organized so that questions about 
trainee and program assessment are considered simultaneously. 

The following eight questions need to be answered specifically and in 
some detail, as an assessment management system is planned. Ideally 
decision regarding these questions will be made by those persons to be 
effected by the decisions. Your time today should be spent in thinking 
about the questions and writing tentative recommendations of answers 
which will result in the best assessment system for your ptogram. 

1. What information (data) is to be used in making decisions "about 
trainee and/or program 

2. Who uses these data-for what purpose 

3. Who is to collect the data 

4. How often are data to be collected 

5. What instruments and procedures are to be used in collecting data 

6. When are data needed (how often) 

7. In what form are data to be kept and/or displayed for those who 
use it 

8. How are decisions and judgements communicated to those persons 
who need to know 

It will soon be evident to serious planners that each of the above 
questions is interrelated, but more important, each is a general question 
Implying many specific questions. 

As you struggle with questions regarding assessment there are two 
principles which I value, and which you may choose to use as guides. 
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Principle 1: Parsimony - In making a decision, don't collect any 
more data, nor involve any more persons than are absolutely necessary. 

Principle 2: Involvement - Those affected by a decision should be 
involved in making it. 

You will notice that each of these principles tends to serve as a check 
on the other. 



WORKTEXT 

Although all questions are interrelated question one is probably the 
place to begin. Some space is proceeded after each question for your 
tentative notes, ideas, and recommendations. i 

I. What information is to be used in making decisions 
A. 

a. What do they need to know? 



b. What teaching skills must they possess? 



c. What pupil outcomes must they achieve? (under what 
conditions) 



d. What other qualities must they possess? What other 
requirements must they meet for certification? 



6 



-5- 

2. Learner Characteristics 

a. Background 

b. Physical Characteristics 

c. Scholastic ability 

d. Personality 

e. Attitudinal 

3. Descriptions of the setting 

a. School 

b. Classroom 

c. Pupils 

B. About Program 

1. Staff 

a. training 

b. performance 

c. etc. 

2. Instruction 

a. modules 

b. scheduling 

c. sequence 

d. etc. 

3 . Inf ormat ion transmiss ion 

4. Logistic support 

5. Record keeping 

6. Assessment and research 



in which teaching has occurred. 
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7. Counseling 



8. Decision making 



NOTE <- Data - about program element might Include descriptive and 
evaluative data - how It works, how effective It Is, what 
It costs In time and dollars. 

Who ^vimi^data <- for what purposes. 

A. What Information about his performance does the trainee need and 
when does he need It. 

1. To help him Improve 



2. For other reasons 

B. What Information do trainee's supervisors need and when? 
1. To help trainee improve 



2« To help supervisor Improve 

C« What information do other Instructors need. 

D. What information do those who make judgements about trainee's 
competency need? When? (Some program designate a panel of ' 
faculty ^ not to include the trainee's supervisor - who makes 
final ju(lgement on a trainee's competency). 



£• What information do program administrators - design need to make 
Judgements about the program. 
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III, Who will collect data? (will this be teachers and supervisors mainly 
or will "third party" observers also be used. 



IV, How often will data be collected? (sampling, validity, cost are 
important here) 



V, What instruments and procedures are to be or can be used to standardize 
simplify and accurately collect data. 



VI, How often are data needed to be displayed for those who use them? What 
data are to be available 

On demand 



One per week - for staff meeting for instance 



At the end of each semester 



For yearly evaluation and revision sessions 



VII. In' what form are data to be kept and/or displayed for users? 
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4.0 



Competencies are treated as tentative predictors of professional effectiveness, and are 
subjected to continual validation procedures. 

Indicators: 4.1 Program includes research component to validate competencies 



Personnel and 
resources are 
specifically 
assigned to 
this component 



Planned 
validation 
effort is 
evident 



Some 
validation 
testing is 
done 



No planned 
validation 
effort IS 
evident 



4.2 Competency statements are continually analyzed and revised 



Statements are 
systematically 
reviewed for pos- 
sible deletion 
or revision for 
each training cycle 



Some competencies 
are revised or deleted 
for each training 
cycle 



Competencies are 
treated as permanent 
objectives 



10.0 Learner progress is determined by demonstrated competence. 

10.1 The student is knowledgable of the general nature of competencies 
and criteria used to determine t^e extent to which performance 
approaches professional standards for acceptability. 



Student describes 
competencies and 
the standards for 
acceptability. 



Student not able 
to describe com- 
petencies request 
or criteria that 
are acceptable. 
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10.2 



Learner progress records are adequately detailed in terms of 
the competencies to be acquired. 



Learner progress records Learner progress 

are adequately detailed, records not kept 

in terms of the com* on file, 
patencies to be acquired. 

10.3 Learner progress records are used to chart future programs' 
directions. 



Learner progress records Learner progress 

are frequently used to records are seldom 

chart program direction. if ever used to chart 

program direction. 

10.4 The demonstration of progress in acquiring the competency is 
the focus of attention in determining the extent to which the 
learner is experiencing success. 



Success is determined by Success is determined 

extent of progress by some other other 

in acquiring the com- criterion such as amount 

petency. of knowledge acquired, 

or number of activities 
completed. 

10.5 The instruction management system makes provisions for students 
to be working at various points of development concurrently. 



Instruction is modularized Instruction is based 

and organized to be carried on the assumption 

out individually or in small that all students 

groups by variable scheduling should acquire the same 

techniques. learnings at the same 

time. 

10.6 
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1 1.0 The extent of learner's progress in demonstrating competencies Is made known to 
him throughout the program. 

Indicators: 11.1 Learner progress records are maintained and available to all 
concerned (learneri instructors^ counselors). 



Learner progress records Learner progress 
are accessible, adequately records are in- 
detailed, and open to accessible, in- 
himself, instructors, and adequate, and/or 
counselors. closed to students, 

1 1.2 The instructional staff (instructors and counselors) and learner 
periodically review progress records in conference. 



Student progress Student progress 

conferences are conferences are 

held frequently. non-existent 

11.3 The instructional management system provides for the frequent . 
and/or continuous updating of the student's progress records. 



Progress records updated* Progress records if 

on a continuing basis. available are only 

updated at infrequent 
(i«e., semester end) 
periods. 

1 1.4 The student is provided with opportunities to acquire skill in 
analyzing and evaluating his own professional behavior. 



In addition to being 
provided with information 
about his progress, the 
student is helped to 
acquire skill in analyzing 
his own professional 
behavior. 

11.5 



Little or no at- 
tention is given 
to the analysis of 
the student's progr^s, 
and hone in helping 
the student acquire 
this skill himself. 
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InstfU^^'^^^' specifications are reviewed and revised based on feedback data. 



indica^^^' 12.1 Specifications for the instructional system are explicit and 
all concerned (students, instructors, counselors, instructional 
professional services personnel, etc.) are aware of these 
specifications. 



A list of specifications Neither specifica* 

for the instructional tions nor policies 

system is published. concerning the 

instructional system 
have been recorded 
much less made 
known to those 
involved. 

12.2 Procedures have been established for having students assess 
the instructional system. 



On a frequent periodic 
or continuing basis 
students are asked to 
react to the effective- 
ness of the procedures 
used in the instruc- 
tional system. 

12«3 A wide range of data is considered in the analysis of the in- 
structional system. (Student time, instructor time, in- 
structional resources, management needs, learner performance, 
etc). 



No attempt is made 
to obtain students' 
reactions to the in- 
structional pro- 
cedures. 



An extensive collection No attempt is made 

of data is used for the to analyze the 

analysis of the instruc- operation of the 

tional system. instructional system. 

12.4 Data obtained from the analysis of the instructional system as 
provided by student feedbac.^ are used to revise the system. 



On a frequent periodic 
or continuing basis the 
instructional system is 
revised from data pro- 
vided by student feedback. 



No systematic or regular 
attempt is made to revise 
the instructional system* 
Changes are made primarily 
on demand from some con- 
dition or authority. 
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Assessment 

13.0 Competency measures are related validly to competency statements. 

Indicators: 13 J A listing of performance indicators is included with each com- 
petency statement. 



Multiple indicators Few competency No competency 

are present for all statementa-have statements 

competency state- multiple have more than 

ments indicators one indicator 

13.2 Indicator^are logically related to competency statements. 



all some none 

corhpetencies of them 

13.3 Measuring instruments are logically related to indicators.. 



all some none 

competencies of them 

13.4 



14.0 Competency measures are specific, realistic, and sensitive to nuance. 

Indicators: 14.1 Competency measures discriminate between learners who 

demonstrate and those who do not demonstrate competency. 



All measures Most measures Undetermined 

most of the time most of the time 

14.2 Measures assess consistency of performance over trme. 
Always Usually Seldom 
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14.3 Reliability of instruments is known and high. 



Computed for Some Not known 

ail instruments instruments 
and high 

14.4 Procedures for measuring competency demonstration are 
^ specified so as to assume quality and consistency. 



Generally followed Procedures not 

and known by data specified, known 

collectors or followed. 

14.5 Data collection procedures require realistic time and resource 
expenditures by-students and staff. 



14.6 



Realistic Unrealistic 
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16.0 Data provided by competency measures are manageable and useful in decision making. 
Indicators: 16.1 Data are collected and stored in an easily retrievable form. 



Data on competency Some data are Not collected or 

measures are col- collected, storage not stored, 

lected and centrally not planned or 

stored. centrally located. 

16.2 Data are reported at pre-specified decision points. 



Reports are helpful Some reports are No reports are 
to decision makers made as a result generated. 

of special needs. 

Data are used in making programmatic decisions. 



Data are generated Occasionally data Not use^ ^ ^ 
as a basis for de- used as a basis 

cision making. for decisioh 

making. 

1.4 Date collection and analysis procedures are feasible in terms 
of time, personnel, and resources. 



Efficiently handled 
within resources. 



Collected but 
seldom used 
because pro- 
cedures are 
cumbersome. • 



16.5 Data are easy to interpret 



Burden is on 
program, or 
not collected. 



Format of data 
analysis is clear. 



Not easily 
tnterpretable. 



16.6 
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17.0 



Competency measures and standards are specified and made public prior to instruction. 
Indicators: 17.1 Competency measures and standards are in a written form. 



For all competency Some are None are 

measures and ^available. written, 

standards. 

17.2 Competency measures and standards are specified in advance. 



yes for some no 

17.3 Students can describe competency measures and standards. 



all known to them some known unknown to 

students 

17.4 Procedures for demonstrating competencies are known to 
students and faculty. 



Known to alL Known to some. Unknown to 

students. 



17.5 



Governance and Management 

18.0 Policy statements are written to govern, in broad outline, the intended structure, 
content, operation and resource base of the program. 

Indicator's: 18.3 Policy decisions are supported by and made after consideration 
of data on program effectiveness and resources required. 



Data are collected, and No research base exists 

systematically stored, for policy decisions, 

and considered in re- Policies are the result of 

viewing, changing or power relationships 

creating policies. and personal opinions. 



17 



22.0 Research and dissemination activities are an integral part of the total instructional 
system. 

Indicators: 22.1 A research strategy for validating and revising the program is 
operational. 



Written procedures. Some efforts to Not being 
hypotheses, date; study results of done, 

systematically applied, program. 

22.2 Reports of completed studies are used in revising program. 



Numerous written Data or unwritten No reports. 

reports available, reports available. 

used. 

22.3 Research management system is operational. 



Yes, comprehensive. Some processes. Not 
workable, working. not systematla operational. 



22.4 Procedures for sharing results with other programs and for 
obtaining their reports are operational. 



Regularly shares with "-:Haphazard:^^ 

at least two programs, of results with other than casual 

some sharing with other programs ones, 

ten others. 

22.5 Staff can describe the research strategy, on-going studies, and 
conclusions of previous efforts. 



22.6 



All staff Some Only for studies 

he is engaged in. 



18 



24.6 The program Is planned and operated as a totally unified, integrated system. 
Indicators: 24.1 The program was planned as a totally integrated system. 



Total program Courses compiled Independent 

designed prior into a program. parts grouped 

to Independent together and 

P^^- called a program. 

24.2 The program is operated as a system. 



Decisions reflect 
consideration of 
tiie total system. 



24.3 Management is by objectives. 



Many 
isolated 
independent 
decisions. 



Yes 



Somewhat 



24.4 Evaluation system provides continual feedback to assess 
objectives achievement for various sub-systems. ^ 



Data available 
and used. Program 
revised. 



Data occasionally 
used. 



^ne 
operational* 



24.5 When making decisions on one phase of the program, impact 
on other sub-systems is calculated and considered^ 

Always Sometimes Never 

24.S The sub-systems are cd 

Yes Somewhat No 

24.7 Harmony in principles among various sub-systems is apparent. 



Internal 
consistency 
easily apparent. 



Consistency can 
be generally 
identified. 



No consistency, 
or not 
considered. 



24.8 The program is continually evaluated against the actual pro- 
fessional needs, and refined based on feedback. 



Formal review 
structure 

operatlbhal;^^^^^^^^ 1^^^ 
change^ 



Program not 
amenable to 
modification. 
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We are attempting to evaluate the syllabus for this class. Listed below are 
each of the sections of this syllabus. In the first column, please indicate if you 
studied that section or not. If you studied that section, indicate if you felt it was 
adequate or not, and if you felt that it was not, please indicate what you think could 
improve that section in the space provided, such as eliminate, condense, re-write, 
clarify, expand, etc. 
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Instructions: Please report on the learning activities you engaged in 
as you studied this unit. 



1. Reading Text 

2. Lecture on X 

3. Lecture on Y 

4. Lecture on Z 

5. Film " 



6. Help Session 



7. Supplementry Reading A 



8. Supplementry Reading B 



9. Conference with 
Instructor 



10. Studying with other 
Students 



11. Other: 



Very Helpful - Worthless 
5 4 3 2 



:z j 0 

■~J 0 
H.:] 60 

-H 0 
— 1 60 



Minutes Spent 
0 - 30 f~ i 30 - 
60 - 120 TUn 120 - 

- 30 30 - 

- 120 r 1 120 - 



60 ^ 
more;'^ 

60 j 
more^ 



0 
60 



30 
120 

30 

120 1 
- 30 I 



rzn 30 

tZZ3120 



- 60 

- more 



30 - 60- m 

J 120 - morel 



30 - 60 



- 120 ]ZZ:J 120 - 



D 0 
□ 60 



ZZ] 0 - 
~1 60 - 

— ! 60 - 



30 
120 

30 
120 

30 
120 



30 
120 



30 
]120 



more® 

60 -'M 



- morer^ 

- 60 ' 



- more 



3 30 
'J 120 



morevf 



- 60 



3 0-30- L1I3 30 - 60— 
J 60 - 120 nU 120 - more- 



n 0 - 30 CU 30 - 60 



60 - 120 dZI 120 - 



Zl 0 - 30 CU 30 
Zl 60 - 120 I -' 120 



more'S 

60 ■;;^| 

more'il 



PROJECT 4 - CX)NFUSION QUESTIONNAIRE 



OBJECTIVE 

The common college experience is altogether unlike the ISIEP^^:^^^^ / 
experience. The demand of self discipline on the part of the student ^ 
in individualized instruction is a substantial change from the spoon-^^^ 
fed approach. . . 

There is ample reason to believe, if you listen to deiiartmentai ^ C ' 
secretaries, that many entering ISTEP students are confused about vari^^^^ 
aspects of the 'program. '?:V''^' ■ 

It is the objective of a properly structured quest 
determine where and how serious the confusion is. ^'-'-r-y/^., \' -'^^ [■':'■ 'V^^ 



Areas where confusion commonly surfaces are: - > " ' -^^^^^^ 

1. How 1 6;^ work -ba' modules ■ • ""^--'^^ v.""^.^ 

2. Grading procedures ' '^'-^O^' 

3. Overall requirements of program , ^ \ ^ r J - ^ ^ \ " ; . -"^/^V^'/M 
4 • Expectations of student rperformance^on^ service projects v ^ - '■■'■i^^ 

5. Expected performance during student teaching < : . . \i 

6. Requirements for completing a quest . ii^^? 

It is apparent that confusion about some of the above items, and \^/' 
others would-not arise until later in the term.. Questionnaires .Vere ^ -^1 

thus given during the third, seventh, and eleventh weeks. * '^''^'•'''^^ 
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When that confusion occurred by marking the timeline from 
the first week in the semester you felt the confusion to. 
the week when your confusion on the particular item 
disappeared. 

C. What confused vou in the area (it is important that you write 
specifically what it was that confused you) . . 

Whether o r not you attended a seminar or help session to 
help you with this objective. If you DID attend- a seminar 
or help session, circle the number of the question. 

Example: 1. Requirements for Quests 

a- 3^ (amount of confusion) ^ 



b. 



week 
i 



c . How do 3 write a Quest- IhropoM 



ERLC 




QUESTIONNAIRE #1 



Students responded to the following questions by circling a 
number 1-7 on a scale opposite each question. Exasnple: Question 1 



I« Registration Procedures 





2 1 3 ! 4 


5 













2. Where to go for help 

3. What is an objective 

4. How to fulfill objectives 

5. Requirements for Quests 

6. Keeping a Journal 

7. How to find staff, materials, 
returned objecives, etc. in the 
IRC and McKay Building > 

8. How to use the syllabus 

9. Contracting and renegotiating 

10. Goal Setting 

11. Seminars 

12. Campbut 

13. Requirements for Service Project 

14. School Visits 

15. Concept of Teaching 

16. Personal Development Unit 

17. Adolescent Development Unit 

18. Health Unit 

19. Administrative Aspects of Teaching 



21. Instruction Unit 

22. Classroom Management Unit 

23. Unit flow chart j? 



QUESTIONNAIRE n 



Students responded to the following questions by circling a number 1-7 
on a scale opposite each question. Example: Question I 

I. How do I use a form 1 and what is all the a. 
information on it for? 



1 ^2 ' 


1 3 U 1 










m 





2« How to find staff, materials, returned 
objectives, etc. in the lAC-McKay Bldg. 

How to prepare for the simulation game « 

4« How to use Administrative Aspects of 
Teaching Evaluation sheets « 

Position and situation assignment in the 
Administrative Aspects of Teaching 
Simulation Game. 



Choos ing and using learning ^ 
activities. 



6. 
7. 



Newspaper editorials in Slinulation Game 

Ideas to be Learned in Simulation Games 
(Administrative Aspects) r. - 

FiTOcedures and rules in the Simulation 

-Game."'" — — ■ — ^ ^^-^ ■ 




9. 
10. 



Required and optional objectives list. 

Having a vision of whajt ISTEP is and 
should be. 



11. Introduction Unit 

12. Personal Development Unit 
13 • Adolescence Unit 

Health Unit 
Curriculum Unit 
Instruction to v ■ 



QUESTIONNAIRE #3 



Students responded to the following questions by circling a number 1-7 
on a scale opposite each question. Example: Question 1 



1. What is required to pass Micro- teaching 
lesson? 



a. 
b. 
c. 



H 


i' 2 : 3 1 










1 1 1 









2. Concept of Teaching 

3. What happens when you finish this 
semester and what happens if you don't? 

4. What is required on the Individualized 
Unit, Objective G-477? 

5. What do you do when yoii can't find material 
in the LRC? 

6. Inductive Teaching 

1. Expanded Inquiry, Objective G-476 

8. Introduction to Syllabus Unit 

9. Personal Development Unit 
ID, Adolescent Developmer^. Unit 

11. Health Unit 

12. Curriculum Unit 

13. Classroom Management Unit 

14. How to write a programmed unit 

15. Problem-Solving Theory 

16. Classifying Questions 
17 • Anaylzing Objectives 

18. Evaluation Theory 

19, Chbosittg and Using Learning^^ 

20 • Reading the flow chart: in Ubiei G l^ 



r t^HtK-. J i««ir*;«d 
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